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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
1/5/2010 has been entered. 

Response to Arguments 

2. Applicant's arguments filed 1/5/201 0 have been fully considered but they are not 
persuasive. In re pages 11-12, the applicants argue that Nagasaka fails to teach the 
newly added limitation of "wherein the preprocessing unit extracts a plurality of static 
image data and each static image data has a variable time width". Cols. 10, lines 46-50 
and col. 15, lines 46-67 are cited as teaching shot-representative pictures are extracted 
at predetermined intervals. 

3. In response, the examiner respectfully disagrees. The examiner would like to 
point to the alternate mode wherein the system of Nagasaka extracts shot- 
representative pictures at the discovery of a new shot/scene. Col. 9, line 8 through Col. 
10, line 67 discusses the digest making process wherein the shot-representative 
pictures are extracted when a new scene/shot is determined. Figure 7 displays a result 
of such wherein over several 15 minute intervals between 1 1 :00 and 12:00, various 
different numbers of shot-representative pictures have been extracted, e.g., between 
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1 1 :00 and 11:15, 4 shot-representative pictures have been extracted. Similarly, within 
the next three 15 minute intervals a different number of 2, 7 and 3 shot-representative 
pictures have been extracted, therefore, it is clear that Nagasaka also teaches a method 
wherein the shot-representative pictures are extracted over a non-predetermined time 
width, therefore, the shot-representative pictures have a variable time width. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 1-31 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Saunders et al. (US 2006/02881 1 3) in view of Nagasaka (US 5,974,21 8). 

Regarding claim 1, Saunders et al. teaches an image reproduction system that 
reproduces static image data synchronously with reproduction of video data, 
comprising: 

a position information obtainment unit that obtains a reproduction time position of 
the video data as the video data is reproduced (Paragraph 42 teaches wherein a 
content author can determine the rendering time for a video component of the entire 
presentation. Fig. 5 further shows where Video 502 is synchronized along with other 
media samples/data. Paragraph 44 teaches that rendering times for each video 
sequences 714 are stored by the format writer 716 as part of the presentation. 
Paragraphs 54-57 teaches a renderer that uses a browser 758 or a multimedia player 
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760 that receives the presentation and reproduces according to the rendering times set 
in the presentation); 

an image obtainment unit that obtains extracted static image data associated in 
advance with the obtained reproduction time position (Paragraph 42 teaches wherein a 
content author can determine the rendering time for each media sample ("HTML, 
image") of the entire presentation. Fig. 5 further shows where media samples within 
Banner 504, Slides 506 are synchronized along with other media samples/data. 
Paragraph 44 teaches that rendering times for media samples are stored by the format 
writer 716 as part of the presentation. Paragraphs 54-57 teaches a renderer that uses a 
browser 758 or a multimedia player 760 that receives the presentation and reproduces 
according to the rendering times set in the presentation); and 

an image reproduction unit that reproduces the obtained static image data 
synchronously with the video data (Fig. 5 and Paragraphs 51-53 teaches where a client 
access a presentation which is reproduced according to the rendering times set by the 
user as discussed above). 

However, Saunders fails to particularly teach a preprocessing unit that extracts 
static image from the video data by an operator operation that performs the setting 
operation while viewing the data before a disposition registration of the video data is 
initiated, wherein the preprocessing unit extracts a plurality of still image data and each 
static image data has a variable time width . 
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In an analogous art, Nagasaka et al. teaches in col. 3, lines 43-48, col. 3, line 56 
through col. 4, line 35, col. 9, line 9 through col. 10, line 67 wherein a broadcast 
program is programmed to be recorded by a user. During the recording of the broadcast 
program a digest picture is extracted from the video program. The extraction of shot- 
representative pictures are extracted based on a detection of a new scene/shot. The 
scene/shot length can vary from one scene to the next according to the broadcast 
program and hence the extraction of the static image (generation of shot-representative 
pictures) is based on a variable time-width. 

The system of Saunders et al. can be modified to allow for capturing and storing 
of the still image files, as taught by Nagasaka so that the extracted still images can be 
used for the media presentation file of Saunders et al. Thereafter, the still images of 
Nagasaka can be added to the existing presentation to finalize a presentation as 
desired. The still images are extracted even before the corresponding broadcast 
program has completed recording, therefore, the system of Saunders et al. can not 
utilize the extracted digest pictures or the associated video. Therefore, the extraction of 
the digest picture occurs before a disposition registration can even begin. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the ability to extract a still image from a video data 
stream as taught by Nagasaka so that information relative to the video can be used for 
the media presentation file of Saunders et al. 
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Regarding claim 2, Saunders et al. teaches an image reproduction system that 
reproduces static image data synchronously with reproduction of video data, 
comprising: 

a delivery server that holds the video data and static image data associated with 
the video data (paragraph, 49, media server 742); and 

a browsing client that reproduces and displays on a screen the video data and 
static image data provided by the delivery server (paragraphs 51-53, client browses a 
presentation), 

wherein the browsing client comprises: 

a position information obtainment unit that obtains a reproduction time position of 
the video data as the video data is reproduced (paragraphs 54-57 teaches a renderer 
that uses a browser 758 or a multimedia player 760 that receives the presentation and 
reproduces according to the rendering times set in the presentation (as discussed in 
claim 1 above)); 

an image request unit that makes a request to the delivery server for the static 
image data associated in advance with the reproduction time position (paragraphs 51- 
53 teaches where a user on a client machine requests a particular presentation to be 
accessed/viewed. The presentation includes the still images within media samples); and 

an image reproduction unit that reproduces the static image data synchronously 
with the video data, the static image data being provided by the delivery server in 
response to the request (paragraphs 56-57 teaches where a presentation, which 
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includes video 502 and images stored by itself or within Banners 504 and/or Slides 506 
are reproduced in synchronism). 

However, Saunders fails to particularly teach a preprocessing unit that extracts 
static image from the video data by an operator operation that performs the setting 
operation while viewing the data before a disposition registration of the video data is 
initiated, wherein the preprocessing unit extracts a plurality of still image data and each 
static image data has a variable time width . 

In an analogous art, Nagasaka et al. teaches in col. 3, lines 43-48, col. 3, line 56 
through col. 4, line 35, col. 9, line 9 through col. 10, line 67 wherein a broadcast 
program is programmed to be recorded by a user. During the recording of the broadcast 
program a digest picture is extracted from the video program. The extraction of shot- 
representative pictures are extracted based on a detection of a new scene/shot. The 
scene/shot length can vary from one scene to the next according to the broadcast 
program and hence the extraction of the static image (generation of shot-representative 
pictures) is based on a variable time-width. 

The system of Saunders et al. can be modified to allow for capturing and storing 
of the still image files, as taught by Nagasaka so that the extracted still images can be 
used for the media presentation file of Saunders et al. Thereafter, the still images of 
Nagasaka can be added to the existing presentation to finalize a presentation as 
desired. The still images are extracted even before the corresponding broadcast 
program has completed recording, therefore, the system of Saunders et al. can not 
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utilize the extracted digest pictures or the associated video. Therefore, the extraction of 
the digest picture occurs before a disposition registration can even begin. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the ability to extract a still image from a video data 
stream as taught by Nagasaka so that information relative to the video can be used for 
the media presentation file of Saunders et al. 

Regarding claim 3, the proposed combination of Saunders et al. and Nagasaka 
teaches the claimed as discussed above in claim 1 , and furthermore, Saunders et al. 
teaches the claimed further comprising: 

a specification unit that accepts reproduction time position information of the 
video data from a user's input (as discussed in claim 1 above, wherein a content author 
can set rendering times for video sequences 502, 714, and the plethora of media 
samples including still images); and 

a video reproduction unit that reproduces the video data from a time position 
corresponding to the accepted reproduction time position information (as discussed in 
claim 1 above), 

wherein the position information obtainment unit obtains time position information 
specified by the user's input (as discussed in claim 1 above, wherein a content author 
can set rendering times for video sequences 502, 714, and the plethora of media 
samples including still images). 
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Regarding claim 4, Saunders et al. teaches an image reproduction system that 
reproduces video data and plural pieces of static image data in association with each 
other, comprising: 

a specification unit that accepts a command provided by a user's input to select 
one piece of static image data from the plural pieces of static image data; (paragraphs 
36-37 teaches wherein a client requests to seek to a particular point in the presentation. 
The client has the ability to seek to a particular point, including the locations of still 
images stored in banner 504 and/or slides 506); and 

a video reproduction unit that reproduces the video data from a reproduction time 
position with which the selected piece of static image data is associated (as discussed 
above, after the client has chosen a particular still image, i.e. a particular location, the 
presentation resumes from that particular location). 

However, Saunders fails to particularly teach a preprocessing unit that extracts 
static image from the video data by an operator operation that performs the setting 
operation while viewing the data before a disposition registration of the video data is 
initiated, wherein the preprocessing unit extracts a plurality of still image data and each 
static image data has a variable time width . 

In an analogous art, Nagasaka et al. teaches in col. 3, lines 43-48, col. 3, line 56 
through col. 4, line 35, col. 9, line 9 through col. 10, line 67 wherein a broadcast 
program is programmed to be recorded by a user. During the recording of the broadcast 
program a digest picture is extracted from the video program. The extraction of shot- 
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representative pictures are extracted based on a detection of a new scene/shot. The 
scene/shot length can vary from one scene to the next according to the broadcast 
program and hence the extraction of the static image (generation of shot-representative 
pictures) is based on a variable time-width. 

The system of Saunders et al. can be modified to allow for capturing and storing 
of the still image files, as taught by Nagasaka so that the extracted still images can be 
used for the media presentation file of Saunders et al. Thereafter, the still images of 
Nagasaka can be added to the existing presentation to finalize a presentation as 
desired. The still images are extracted even before the corresponding broadcast 
program has completed recording, therefore, the system of Saunders et al. can not 
utilize the extracted digest pictures or the associated video. Therefore, the extraction of 
the digest picture occurs before a disposition registration can even begin. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the ability to extract a still image from a video data 
stream as taught by Nagasaka so that information relative to the video can be used for 
the media presentation file of Saunders et al. 

Claims 5-7 and 9-11 are rejected for the same reasons as discussed in claim 2 

above. 

Claims 8 and 12 are rejected for the same reasons as discussed in claim 4 

above. 
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Regarding claims 13-20, the proposed combination of Saunders et al. and 
Nagasaka teaches the claimed as discussed in claims 1-2 and 4-12 above, and 
furthermore, Saunders et al. teaches the claimed further comprising a retrieval interface 
(Fig. 7B and paragraph 49 teaches of a Client Site that retrieves a particular 
Presentation File) including a keyword input part that matches keyword input with 
contents data associated with the image data to retrieve results (Fig. 7B and paragraph 
49 teaches of a Client Site that retrieves a particular Presentation File. In order to 
request a particular Presentation File, information to differentiate one Presentation File 
from another is inherently input by the user. See paragraph 3 above for further 
discussion). 

Regarding claims 21-31, the limitations are met since the broadcast program 
recorded in Nagasaka consists of a plurality of frames. The extracted digest picture a 
single frame from the plurality of still frames that is used to create a video program. 
Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to GELEK TOPGYAL whose telephone number is 
(571)272-8891 . The examiner can normally be reached on 8:30am -5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Thai Tran can be reached on 571-272-7382. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Gelek Topgyal/ 
Examiner, Art Unit 2621 



/JAMIE JO ATALA/ 

Primary Examiner, Art Unit 2621 



